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Abstract 


““  t  Though  vehicles  that  use  legs  for  locomotion  promise  superior  mobility  and  versatility,  very 
little  re  known  about  their  design  and  control.  Balance,  resonance,  and  dynamic  control  are  key 
issues  underlying  high  performance  legged  systems,  both  man-made  and  biological,  yet 
understanding  in  these  areas  is  particularly  lacking.  We  focus  attention  on  these  important  problems 
by  studying  hopping  systems  that  have  only  one  leg.  A  one-legged  system  must  hop  to  locomote, 
must  balance  to  hop,  and  must  be  dynamically  controlled  at  all  times  to  balance. 

An  ideal  one-legged  planar  hopping  machine  is  presented  with  its  equations  of  motion. 
Control  is  decomposed  into  a  vertical  hopping  part  and  a  horizontal  balance  part.  A  total  vertical 
energy  measure  is  used  to  control  uniformity  of  hopping  height  when  there  are  mechanical  losses  and 
irregular  terrains.  Balance  and  control  of  horizontal  translation  are  explored  through  implementation 
of  three  controllers:  a  linear  feedback  controller,  a  stance  controller,  and  a  new  table  look-up 
controller. 

The  design  and  operation  of  a  physical  planar  hopping  machine  is  discussed,  along  with 
preliminary  experimental  results  for  vertical  control.  Three  new  designs  for  experimental  vehicles  that 
operate  in  3-space  are  presented.  Two  are  mechanically  simple  designs  with  functional  symmetry; 
the  third  is  preliminary  concept  for  a  multi-legged  balancing  vehicle  that  is  optimized  for  forward 
motion.  /- — _ 
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1 .  Introduction  and  Summary 

One  need  only  watch  a  few  slow  motion  instant  replays  on  Saturday  afternoon  sports 
television  to  be  amazed  by  the  variety  and  complexity  of  ways  a  human  can  carry,  swing,  toss,  glide, 
and  otherwise  propel  his  body  through  space.  Orientation,  balance,  and  control  are  maintained  at  all 
times  without  apparent  effort,  while  the  ball  is  dunked,  the  bar  is  jumped,  or  the  base  is  stolen.  Such 
spectacular  performance  is  not  confined  to  the  sports  arena  -•  behavior  observable  at  any  school 
playground  is  equally  impressive  from  a  mechanical  engineering,  sensory  motor  integration,  or 
computer  science  point  of  view.  The  final  wonder  comes  when  we  observe  the  one  year  old  infant's 
first  wobbly  steps  with  the  knowledge  that  running  and  jumping  will  soon  be  learned  and  added  to  the 
repertoire.  Animals  also  demonstrate  feats  of  agility  that  make  them  able  to  move  quickly  and  reliably 
over  flat,  hilly,  and  mountainous  terrain,  through  forest,  swamp,  marsh  and  |ungle,  and  some  move 
very  quickly  in  the  open  or  from  tree  to  tree. 

Despite  excellence  in  using  his  own  legs  to  locomote,  man  is  still  at  a  primitive  stage  in  the 
development  and  construction  of  legged  vehicles.  So  far  his  designs  do  not  exhibit  the  mobility, 
agility,  versatility,  and  energy  advantages  of  biological  legged  systems.  They  are  slow,  ponderous, 
and  rarely  leave  the  laboratory.  We  have  neither  theory  nor  understanding  of  legged  locomotion  to 
explain  the  behavior  we  see  in  natural  systems,  nor  to  build  machines  with  similar  properties.  As  a 
result  our  mobility  is  generally  limited  by  dependence  on  roads,  runways,  the  beasts  of  burden,  and 
our  own  two  feet. 

The  work  reported  here  describes  modelling,  simulation,  design,  and  physical  experiments 
with  new  types  of  legged  locomotion  systems.  Our  long  term  goal  is  to  develop  a  systematic 
understanding  of  the  legged  locomotion  problem  in  biology  and  in  robotics.  This  will  help  to 
determine  the  potential  benefits  for  domestic  and  military  exploitation,  to  provide  the  scientific 
foundation  upon  which  useful  transportation  systems  may  be  constructed,  and  to  help  explain  the 
behavior  we  observe  in  naturally  occurring  legged  systems.  No  such  understanding  is  available  today 
and  its  lack  is  sorely  felt. 

Our  shorter  term  objective  is  to  do  experiments  that  let  us  explore  the  basic  issues  underlying 
balance,  dynamic  control,  and  resonant  oscillatory  behavior  as  they  affect  legged  systems.  Our 
choice  of  these  issues  was  triggered  by  two  observations: 

•  Most  biological  walkers  larger  fian  insects  depend  on  active  balance  and  dynamic 
stability  as  basic  operating  principles.  Existing  man-made  walking  machines  rely  solely 
on  static  techniques  for  support. 

•  Biological  systems  have  elastic  muscles  and  tendons  that  participate  in  resonant 
mechanical  oscillations  during  locomotion  [4, 186],  whereas  man-made  walkers  usually 
have  rigid  legs  with  no  suspension. 

We  have  taken  these  observations  to  heart  in  formulating  our  studies  of  legged  locomotion.  The  main 
issues  then  are  balance  and  resonant  oscillation.  Our  method  of  focussing  on  these  issues  is  to 


experiment  with  hopping  systems  having  only  a  single  leg  --  neither  balance  nor  oscillation  may  be 
ignored.  Because  only  one  gait  is  possible  for  a  one  legged  device  [169],  the  problem  of  gait 
selection  is  particularly  simple  and  does  not  distract  us  from  the  central  issues  of  this  research. 

During  walking,  running,  and  hopping,  legs  do  two  things.  They  store  energy  in  springy 
muscle  and  tendon  when  the  leg  shortens,  returning  some  of  it  when  they  lengthen,  and  they  move 
back  and  forth  to  propel  and  to  provide  balance.  We  have  modelled  this  behavior  in  an  experimental 
vehicle  with  a  single  leg  that  changes  length  by  means  of  a  large  spring,  and  a  simple  rotary  hip  that 
moves  the  leg  back  and  forth.  We  call  this  model  the  Ideal  Planar  Hopper.  (See  Fig.  2-1 .) 

We  decompose  control  of  the  planar  hopper  into  two  parts,  a  vertical  hopping  part  and  a 
horizontal  balance  part.  The  primary  role  of  the  vertical  controller  is  to  establish  a  regular  framework 
within  which  alternating  stance  phases  and  transfer  phases  occur.  The  basic  timing  and  rhythm  of 
locomotion  is  governed  by  this  vertical  oscillatory  system.  The  horizontal  part  is  responsible  for 
balancing  the  system  and  causing  it  to  translate  from  place  to  place.  All  the  actions  of  the  horizontal 
part  are  synchronized  by  key  events  in  the  vertical  hopping  cycle. 

It  is  the  purpose  of  vertical  control  to  achieve  stable,  energy  efficient  hopping  that  provides  a 
framework  within  which  locomotion  can  take  place.  We  developed  an  asynchronous  hopping  cycle  in 
which  each  control  action  is  keyed  to  one  of  four  events:  lift-off  -  the  foot  leaves  the  ground,  peak  - 
the  vehicle  is  momentarily  suspended  in  air  at  the  top  of  a  hop,  touch-down  -  the  foot  touches  the 
ground  during  landing,  and  bottom  -  the  leg  is  shortened  at  the  bottom  of  a  hop.  We  found  that  a 
measure  of  total  vertical  energy  in  the  locomotion  system  is  useful  in  predicting  and  controlling 
hopping  altitude,  despite  mechanical  losses  and  irregular  terrains. 

There  are  two  ways  to  control  horizontal  behavior  of  the  hopper.  One  is  to  manipulate 
placement  of  the  foot  just  before  touch-down  -  placement  will  determine  the  direction  of  falling 
during  the  subsequent  stance  period.  The  other  way  is  to  apply  torque  to  the  hip  during  stance, 
thereby  changing  the  angular  momentum  of  the  body.  We  have  experimented  with  three  methods  for 
balance,  two  that  only  use  foot  placement,  and  a  third  that  combines  foot  placement  with  hip  torque. 

Linear  Foot  Placement 

This  first  method  determines  foot  placement  as  a  linear  function  of  errors  in  the 
three  important  state  variables:  body  angle  02 ,  body  angular  rate  >f?,  and 
horizontal  body  rate  x2  as  defined  in  Figure  2-1 .  The  leg  is  positioned  just  before 
touch-down  so  that  the  horizontal  distance  between  the  foot  and  the  projection 
of  the  vehicle's  center  of  gravity  is  specified  by  this  linear  function.  In  simulation 
we  have  found  that  this  simple  approach  is  very  good  at  maintaining  balance.  A 
wide  variety  of  initial  conditions  and  disturbances  are  permissible  without  causing 
crashes.  However,  we  also  found  that  limit  cycles  in  horizontal  velocity  are  hard  to 
avoid. 


3 


Predictive  State  Space  Method 

As  a  follow-up  to  Raibert’s  earlier  work  on  robot  manipulator  dynamics  [227, 228], 
we  explored  a  control  method  that  uses  a  largo  table  •  about  10,000  numbers  •  to 
control  the  simulated  hopper.  The  Predictive  State  Space  Method  is  able  to  make 
a  very  useful  prediction  just  before  each  touch-down  -  for  each  possible  foot 
placement  it  predicts  the  vehicle’s  state  at  the  time  of  next  lift-off.  These 
predictions  are  used  to  select  the  best  foot  placement  at  touch-down  during 
each  hopping  cycle.  This  table  look-up  method  provides  a  tubular  solution  to  the 
vehicle's  nonlinear  equations  of  motion,  where  no  closed  form  solution  is  known. 

The  performance  of  the  predictive  state  space  controller  is  very  good.  Not  only 
can  it  balance  and  perform  well  controlled  translations,  but  in  contrast  to  the 
linear  method,  horizontal  velocity  is  controlled  with  great  precision. 

Sweep  Control  Sweep  control  grew  from  a  simple  observation:  During  the  stance  part  of  constant 
velocity  horizontal  locomotion,  a  legged  vehicle's  center  of  gravity  translates  by  a 
predictable  amount  at  a  fixed  rate.  Therefore,  it  is  possible  to  plan  a  sweeping 
motion  of  the  leg  during  stance  such  that:  a)  the  constant  horizontal  velocity  of  the 
body  is  not  impeded,  and  b)  balance  is  maintained.  This  form  of  control  combines 
foot  placement  with  hip  torque.  For  the  special  case  of  zero  horizontal  velocity, 
the  method  simplifies  to  the  linear  controller  described  above. 

Simulations  of  sweep  control  have  provided  our  most  exciting  results  to  date. 
Very  high  horizontal  velocities  are  achievable,  stability  is  very  good,  and  the 
resulting  locomotion  begins  to  look  very  like  the  behavior  of  biological  systems. 
Figure  1-1  shows  a  sequence  of  vehicle  positions  obtained  in  a  simulation  of 
sweep  control. 
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We  have  designed  and  fabricated  a  physical  hopping  machine  that  serves  as  a  testbed  for  the 
ideas  developed  through  analysis  and  simulation.  Figure  1-2  is  a  photograph  of  the  planar  hopping 
machine  in  its  present  state.  Two  pneumatic  cylinders  act  together  under  computer  control  to  excite 
vertical  oscillations,  and  to  balance  through  horizontal  leg  motion.  Presently,  all  sensory  information 
is  provided  by  an  electro-optical  sensor,  Selspot,  that  watches  the  hopper’s  behavior  from  a  nearby 
tripod.  Other  sensors  are  in  various  stages  of  development:  linear  encoder,  rate  gyro,  down  looking 
sonar,  and  more  sophisticated  use  of  the  Selspot. 

We  have  implemented  a  very  simple  vertical  control  that  excites  and  maintains  resonant 
hopping  oscillations  in  the  physical  hopper.  Our  design  goal  of  three  inch  ground  clearance  on  each 
hop  is  now  achieved  consistently  since  improving  the  mechanical  design  of  the  system’s  air  bearings 
and  the  leg's  linear  bearing.  We  have  begun  work  on  controlling  balance,  but  have  no  results  at  the 
time  of  this  writing.  Our  progress  in  achieving  balance  has  been  delayed  because  of  a  bad  design 
decision  made  early  in  the  project:  Bang -bang  pneumatic  control  of  coupled  actuators  is  a  tricky 
business  that  is  best  avoided.  We  discuss  plans  to  overcome  difficulties  imposed  by  this  problem. 

We  have  begun  to  explore  locomotion  in  three  dimensions.  Three  preliminary  mechanical 
designs  are  presented  for  one-legged  experimental  vehicles  that  will  locomote  in  3-space  without 
mechanical  support.  Two  are  candidates  for  experiments  in  the  coming  months  ••  the  third  is  a 
design  that  looks  to  the  future  when  multi-legged  vehicles  will  incorporate  balancing  control  systems. 
As  with  our  planar  work,  the  major  emphasis  is  on  balance  and  resonance.  Elastic  elements  play  a 
central  role  in  all  three  vehicles  providing  energy  conservative  vertical  motion  and  high  performance 
balance  motion.  These  new  designs  incorporate  improvements  based  on  what  we  are  learning  from 
the  planar  hopper. 
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2.  Analysis  and  Simulation  of  Planar  Hopping 

2.1  A  Simple  Model 

A  seed  that  lead  to  these  studies  was  planted  when  we  noticed  that  during  locomotion 
biological  legs  do  two  things:  they  change  length  and  they  change  angle.  It  usually  doesn't  matter 
whether  the  animal  is  walking,  running  or  hopping,  or  whethe*-  the  leg  is  part  of  a  quadruped,  biped, 
or  monoped  (eg.  hopping  kangaroo). 

Legs  change  length  to  propel  the  body  forward  and  upward,  and  to  reduce  their  own 
moments  of  inertia  when  they  swing  forward.  They  absorb  energy  in  springy  muscle  and  tendon 
during  landing,  and  return  it  during  take-off.  Legs  also  swing  back  and  forth.  This  motion  permits 
feet  to  be  precisely  positioned  with  respect  to  an  animal’s  center  of  gravity,  and  permits  torques  to  be 
applied  to  change  angular  momentum. 


Figure  2-1:  Diagram  of  ideal  one  legged  hopping  mechanism,  Ideal  Planar 
Hopper. 


We  have  modelled  this  behavior  in  a  vehicle  with  a  single  leg  that  changes  length  under  the 
influence  of  a  large  spring,  and  that  rotates  about  a  simple  rotary  hip.  This  very  simple  model 
captures  what  is  important  in  dynamic  locomotion  while  avoiding  the  complications  implicit  in 
systems  with  many  legs.  Figure  2-1  shows  the  idealized  mechanical  system  under  study.  A  leg  of 
mass  Mr  moment  of  inertia  I,  is  connected  to  a  body  of  mass  M2  moment  of  inertia  l2.  A  joint  between 
these  links  permits  linear  sliding  motion  and  rotation.  Control  torque  u1(t)  is  applied  to  a  rotary  joint  at 
the  hip.  Linear  motion  of  the  body  sliding  on  the  leg  is  controlled  by  a  spring  of  stiffness  «s  and 
length  w  in  series  with  a  linear  position  source  of  length  u2(t).  The  linear  actuator  adjusts  the  spacing 
between  the  body  and  spring  to  control  forces  acting  between  the  leg  and  body.  A  mechanical  stop, 
modelled  as  a  very  stiff  region  of  the  main  spring,  limits  extension  of  the  mam  spring  beyond  its  rest 
length.  For  w  >  wQ  +  u2  the  spring  becomes  stiff,  Kg  =  K^,  and  damped,  B  =  B^. 

The  ground  is  modelled  as  a  two  dimensional  spring  and  damper  (  KQ,  BQ ).  One  spring  acts 
vertically,  the  other  horizontally,  with  no  interaction.  This  spring  and  damper  influences  the  hopper 
only  when  the  foot  is  in  contact  with  the  ground,  yQ  <  0.  Each  time  the  foot  touches  the  ground  the 
rest  position  of  the  horizontal  ground  spring  is  reset. 

Equations  of  motion  for  the  entire  mechanical  system  are  found  in  Appendix  I.  Since  we  have 
no  closed  form  solution  to  these  differential  equations,  a  numerical  algorithm  is  used  to  determine  the 
system’s  behavior  as  a  function  of  time.  All  the  simulations  discussed  below  are  accomplished  by 
using  such  numerical  solutions  in  conjunction  with  the  controllers  being  studied.  The  numerical 
constants  used  throughout  the  paper  are  given  in  Appendix  II. 

2.2  Control 

There  are  two  sets  of  behaviors  that  are  central  to  our  study  of  planar  hopping:  vertical 
oscillation  and  horizontal  balance.  The  vertical  part  involves  generating  a  stable  series  of  resonant 
oscillations  that  take  a  system  off  the  ground  and  control  the  height  of  each  jump.  The  horizontal  part 
must  maintain  balance  during  hopping,  and  achieve  the  correct  lateral  position  and  translation  over  a 
support  surface. 

2.2.1  Vertical  Control  ••  Hopping 

Unlike  a  wheel  which  changes  its  point  of  support  continuously  and  gradually  while  bearing 
weight,  a  leg  changes  its  point  of  support  all  at  once  and  must  be  unloaded  to  do  so.  Therefore,  in 
order  for  a  legged  system  to  progress  there  must  be  a  framework  of  activity  for  each  leg  in  which 
there  is  a  time  when  the  leg  bears  weight  and  the  foot  cannot  be  moved,  and  another  time  when  the 
leg  is  unloaded  and  the  foot  free  to  move.  Such  an  alternation  between  a  loaded  phase,  called 
stance,  and  an  unloaded  phase,  transfer,  is  found  in  every  form  of  legged  locomotion.  For  systems 
with  a  single  leg  or  a  set  of  legs  that  act  together,  the  transfer  phase  is  also  the  flight  phase,  and  we 
call  the  alternation  cycle  hopping.  To  first  order  a  vertical  controller  is  responsible  for  providing  such 
an  alternation  framework. 
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We  have  designed  a  vertical  controller  that: 

•  Initiates  hopping 

•  Controls  the  height  of  hopping 

•  Maintains  stable  hopping  during  horizontal  control 

•  Terminates  hopping 

The  basic  mechanism  through  which  each  of  these  actions  is  accomplished  is  controlled  excitation  of 
a  spring/mass  gravity/mass  oscillator.  Hopping  is  initiated  by  exciting  the  spring/mass  oscillator 
with  a  linear  actuator  until  escape  velocity  is  reached  -  when  inertial  forces  are  sufficient  to 
overcome  gravity  the  foot  leaves  the  ground  and  hopping  begins.  At  this  point  the  system  becomes  a 
spring/mass-gravity/mass  oscillator.  Four  events  in  the  oscillation  cycle  are  of  particular  interest: 

•  lift-off  -  the  moment  the  foot  leaves  the  ground 

•  peak  -  the  point  in  flight  when  vertical  velocity  changes  from  positive  to  negative 

•  touch-down  -  when  foot  first  touches  the  ground 

•  bottom  •  when  vertical  velocity  changes  from  negative  to  positive 

To  understand  regulation  of  a  hopping  system’s  vertical  behavior  it  is  useful  to  think  about 
energy,  its  storage  and  its  dissipation.  Consider  the  simplified  case  in  which  0V  0V  6Y  and  02  are  all 
small  and  neglected  -  motion  is  primarily  vertical.  For  the  present  model  there  are  six  ways  energy 
can  be  stored: 

1 .  Kinetic  energy  of  body 

2.  Kinetic  energy  of  leg 

3.  Gravitational  potential  of  body 

4.  Gravitational  potential  of  leg 

5.  Elastic  potential  of  the  main  spring  (including  mechanical  stop) 

6.  Elastic  potential  of  the  support  surface,  the  ground 

Therefore,  the  total  vertical  energy  during  stance  is: 

Estance  -  PE0<M1>  +  PEg<M2)+  KE(Mt)  +  KE(M2)  +  PE^M,)  ♦  PEe(M2)  (2.1) 

■  M1gy1  +  M2gy2  +  .SM^2  +  .5  Mgy2  +  .5  Ks(wQ-w  +  u2)2  +  .S^y2 

where 

PEg  -  gravitational  potential  energy 
PEe  -  elastic  potential  energy 
KE  -  kinetic  energy 
g  -  acceleration  of  gravity 
wQ  is  the  rest  length  of  the  spring. 

Notice  that  we  have  chosen  expressions  for  potential  energy  that  are  zero  when  the  hopper  is 
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standing  vertically  with  the  main  spring  extended  and  the  foot  just  touching  the  ground.  This  will 
make  the  analysis  simpler  later.  Ignoring  windage  which  is  typically  less  than  5%  of  the  total,  there 
are  two  ways  energy  can  be  lost: 

1 .  Damping  in  main  spring  (including  mechanical  stop) 

2.  Damping  in  ground  spring. 

There  are  two  events  in  a  hopping  cycle  during  which  most  energy  loss  occurs.  At  touch¬ 
down  most  of  the  leg's  kinetic  energy  is  dissipated  by  ground  damping1: 

‘W  "  KE<M.)  *  <22> 

where 

y2  to  is  the  velocity  just  before  touch- down. 

Subscript  to-  means  just  before  touch-down. 

At  lift-off  damping  in  the  main  spring's  mechanical  stop,  the  stiff  region,  dissipates  a  fraction  of  the 
system’s  kinetic  energy: 


E 


LO-LOSS 


M 


m1  +  m2 


JrrKELo-*M2)  = 


MiM, 

2(M1  +  M2)  2,LO* 


where 

KE,  „  (M„)  is  the  total  kinetic  energy 

y2  io  's  the  ver,ical  velocity  of  the  body  just  before  lift-off 

Subscript  lo-  means  just  before  lift-off. 


(23) 


The  fraction,  M1/(M1  +M2)  was  found  by  equating  linear  momentum  before  and  after  lift-off.  It’s 
interesting  that  this  loss  is  minimized  when  the  leg /body  mass  ratio  is  minimized,  ie.  when  unsprung 
mass  is  minimized. 


In  addition  to  these  energy  losses  there  is  an  energy  source,  the  linear  actuator  of  length  u2. 
Since  this  actuator  is  in  series  with  a  spring  it  does  work  on  the  system  when  it  changes  length.  If  u2 
instantaneously  changes  from  u2 ,  to  u2 .  +  Au2,  then  there  is  an  energy  change: 

AEu^  *  Ks  [  .5  Au2  +  Au2  (wq-w  +  u^)  ]  (2.4) 

Actually  this  actuator  can  also  be  an  energy  sink  -  when  Au2  is  negative  total  energy  is  reduced.  Also 
note  that  the  magnitude  of  AE  depends  on  w  -•  more  work  is  done  when  the  main  spring  is 
compressed  than  when  it  is  relaxed.  Therefore,  lengthening  the  actuator  at  bottom  and  shortening 
during  flight  causes  the  total  energy  in  the  system  to  increase  on  each  hop.  On  the  other  hand, 
shortening  the  actuator  at  bottom  and  lengthening  during  flight  causes  the  total  energy  in  the  system 
to  decrease,  eventually  to  zero. 
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There  is  actually  ground  damping  throughout  stance,  but  such  losses  are  generally  small. 


Now  we  are  ready  to  control  hopping  height,  H.  If  the  main  spring  is  at  equilibrium  during 
flight,  all  energy  takes  the  form  of  gravitational  potential  at  peak  where  y2  =  0  by  definition. 

Therefore,  for  the  case  when  the  vertical  actuator  is  inactive  we  can  predict  the  height  of  the  next  hop 
at  any  time  during  stance.  We  assume  complete  stats  information  to  be  available  and  neglect  ground 
losses  after  touch-down.  At  lift-off  the  total  vertical  energy  takes  the  form  of  kinetic  energy: 


LO- 


=  KElo-  -  E 


STANCE 


(2.5) 


We  know  from  (2.3)  that  there  is  a  fractional  loss  of  kinetic  energy  at  lift-off.  Combining  (2.3)  and 
(2.1)  we  get  the  total  energy  during  flight: 


E 


FLIGHT 


KE 


to* 


(2.6) 


M 


2 —  KE 


m1  +  m2 


LO- 


*  -—2-  t  Mtgy,  +  M2gy2  +  +  ,5M^  +  .5  Kg(w0-w  +  u^2  +  .5KQyg] 

Mi  +  M2 

Now  this  result  can  be  used  to  control  hopping  height.  For  the  body  to  hop  to  height  H  the  total 
vertical  energy  must  be: 


eh  -  M,g  [  H  -  r2cos(02)  -  (wQ-r1)sin(f1)  ]  +  M2gH  (2.7) 

So  at  all  times  during  stance  the  energy  that  must  be  supplied  or  removed  by  the  vertical  actuator  to 
produce  a  hop  of  height  H  is: 


AEh=E„-Elo> 


From  (2.4)  and  (2.8)  the  linear  actuator  must  extend  by: 


(28) 


Au,  =  - (u„  -  w  +  wj  + 


(u,  -  wn  +  W/  + 


K 


(2-9) 


Actually,  if  (2.6)  can  be  evaluated  rapidly  enough,  it  is  not  necessary  to  use  (2.9).  On  each  control 
cycle  the  sign  of  AE  can  be  used  to  determine  if  u2  should  be  lengthened  or  shortened. 


This  method  was  used  to  control  the  height  of  hopping  in  simulation.  At  bottom,  indicated  by 
yQ  changing  sign  from  negative  to  positive,  (2.1)  and  (2.6)  are  used  to  predict  hopping  height.  u2  is 
then  lengthened  or  shortened  accordingly.  Figure  2-2  plots  the  vertical  position  of  the  foot  and  the 
body  during  a  period  of  increasing  hopping  height,  and  during  stable  hopping.  Starting  at  rest,  the 
system  executes  a  positive  work  cycle  on  each  hop  until  the  vertical  energy  increases  to  the  correct 
value.  Then  it  maintains  this  level.  The  finite  response  time  of  a  physical  actuator  is  simulated  by 
making  u2  increase  or  decrease  with  a  quadratic  trajectory.  Since  the  range  of  the  linear  actuator 
stroke  is  finite  the  energy  that  can  be  injected  on  a  single  cycle  is  limited.  Therefore,  a  number  of 
cycles  may  be  required  to  achieve  a  desired  energy  and  height. 


In  these  simulations  shortening  occurs  during  touch-down  by  letting  the  foot  just  touch  the 


Figure  2-2:  Vertical  hopping.  Starting  from  rest,  total  energy  is  increased 
until  desired  hopping  height  is  attained.  Hopping  height  is  regulated  through 
control  of  vertical  actuator  u^. 

ground  until  the  actuator  is  fully  shortened.  If  there  were  no  losses  in  the  system  it  would  not  be 
necessary  to  activate  u2  once  a  desired  height  of  hopping  was  achieved.  However,  since  there  are 


losses  it  is  necessary  to  replace  the  energy  lost  on  each  hop  to  get  level  hopping.  The  vertical 
controller  injects  or  extracts  the  right  amount  of  energy  to  achieve  a  desired  hopping  height  based  on 
of  total  vertical  energy  at  bottom. 

It  is  sometimes  useful  to  describe  the  vertical  control  cycle  in  the  phase  plane.  If  we  plot  body 


i  velocity  on  the  abscissa  and  body  altitude  with  respect  to  its  resting  altitude  on  the  ordinate  we  obtain 

P  a  phase  plot.  (See  Figure  2-3.)  Note  the  parabolic  trajectory  during  flight  caused  by  the  constant 

r .  gravitational  acceleration,  and  the  circular  trajectory  during  stance  due  to  the  spring.  The  four  events 

I  mentioned  earlier,  lift  off,  peak,  touch  down,  and  bottom,  were  chosen  as  control  points  to 

|  synchronize  actions  of  the  controller  with  ongoing  behavior  of  the  hopping  system.  Use  of  these 

I I  events  as  control  switching  points  allows  a  simple  and  reliable  asynchronous  implementation. 


Figure  2-4  plots  vertical  energy  during  two  cycles  of  fixed  height  hopping  (ie.  from  time  7.5  to 
0.3  in  Figure  2-2).  A  lossless  system  would  produce  a  perfectly  flat  total  energy  line.  It  can  be  seen 
that  the  primary  losses  occur  when  the  foot  strikes  the  ground,  and  when  it  leaves  the  ground. 
•i  Energy  increases  during  the  latter  part  of  stance,  when  the  actuator  lengthens.  There  is  also  a  small 


~  energy  increase  when  the  actuator  shortens,  however  this  energy  is  dissipated  by  damping  in  the 

mechanical  stop.  These  data  are  replotted  in  polar  form  in  Figure  2-5a.  In  this  figure  radius  is  the 
magnitude  of  total  energy,  and  angle  is  Arctan(y2/y2).  A  lossless  system  would  produce  a  perfectly 
circular  total  energy  line.  In  this  plot  the  curve  crosses  the  axes  at  the  same  synchronization  points 
«  LIFT-OFF,  PEAK,  TOUCH-DOWN,  and  BOTTOM. 


PEAK 


TOUCH 

DOWN 


BOTTOM 


(m/sec) 


Fkgur*  2-3:  Phase  plot  for  vertical  hopping.  Four  control  events  are  Indicated 
where  curve  crosses  axes.  Data  from  stable  part  of  Figure  2-2. 


Figure  2-5b  plots  energy  for  the  initial  section  of  Figure  2-2.  The  spiral  depicts  the  start-up 
period  during  which  the  system  energy  is  pumped  up.  It  takes  a  few  cycles  to  achieve  desired 
hopping  height.  Figure  2-6  shows  an  80  second  sequence  of  vertical  hopping  in  which  desired  height 
is  adjusted  up  and  down.  The  ability  to  regulate  height  during  vertical  hopping  is  clearly 
demonstrated  here.  Notice  the  difference  between  the  speed  of  the  actively  controlled  descent 
beginning  at  t  •  45  and  the  passive  descent  beginning  at  t  ■  65. 

It  is  interesting  that  the  time  at  which  the  leg  is  shortened  during  a  steady  state  hop  cycle  can 
be  manipulated  to  optimize  a  variety  of  criteria: 

•  When  the  leg  is  shortened  at  lift-off,  ground  clearance  of  the  foot  during  flight  is 
optimized.  This  is  important  when  terrain  is  uneven  or  when  large  horizontal  sweeps  of 
the  leg  will  occur  during  flight,  as  when  translating  at  high  speed.  If  the  leg  is  not  short 
during  these  sweeps  stubbing  the  toe  is  hard  to  avoid.  Shortening  at  lift-off  also 
minimizes  the  leg's  moment  of  inertia  during  flight,  so  the  leg  can  be  swung  forward 
faster  and  with  less  angular  effect  on  the  body. 

•  When  shortening  occurs  at  peak  the  time  between  vertical  actuations  is  maximized.  This 
strategy  could  permit  use  of  an  actuator  of  lower  bandwidth. 

•  If  shortening  occurs  upon  touch-down,  then  the  ground  impact  forces  on  the  foot  are 
minimized.  This  strategy  is  normally  used  by  humans  when  they  are  asked  to  hop  in  place 
on  a  flat  floor. 


Figure  2-4:  Vertical  energy  for  two  hopping  cycles  at  constant  height  Total 
energy,  kinetic  energy,  gravitational  potential,  and  elastic  potential  are  shown. 
Primary  losses  of  energy  are  at  touch  down  and  uft-off.  Data  from  Fig.  2-2. 
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Figure  2-6:  Vertical  hopping  sequence.  At  times  t  *  9,  15,  25,  35,  45.  56, 66 
desired  hopping  height  H  =  1.7,  2.0,  1.6,  1.9,  1.4,  1.9,  1.4.  The  descent 
beginning  at  t  =  65  is  passive. 


It  is  also  possible  to  shorten  the  leg  at  lift-off,  lengthen  it  again  just  before  the  next  touch¬ 
down,  and  let  it  shorten  during  the  landing.  This  strategy,  apparently  used  by  humans  when  running, 
maximizes  ground  clearance  and  minimizes  impact  forces  on  the  foot.  However  this  is  accomplished 
at  the  expense  of  additional  actuator  bandwidth.  Although  more  energy  is  required  for  these  extra 
lengthening  and  shortening  motions,  the  leg  can  be  swung  forward  more  efficiently  with  its  lower 
moment  of  inertia. 


2.2.2  Horizontal  Control  --  Balance 

A  horizontal  controller  maintains  balance  and  controls  lateral  motion.  There  are  two  parts  to 
the  control  of  horizontal  and  angular  behavior  of  a  legged  hopping  system:  a  part  that  works  while  the 
vehicle  is  in  flight,  and  a  part  that  works  while  the  vehicle  is  in  stance.  During  flight  the  leg  can  be 
moved  to  change  the  horizontal  distance  between  the  foot  and  the  center  of  gravity.  This  distance 
will  affect  the  direction  of  falling  during  the  subsequent  stance  period.  During  stance  torques  applied 
to  the  hip  directly  modify  the  body's  angular  momentum. 

Here  we  describe  three  methods  for  balance,  two  that  only  position  the  foot  during  flight,  and 
a  third  that  combines  foot  placement  with  hip  torque.  Biological  systems  usually  employ  both  foot 
placement  and  hip  torque  for  balance.  However,  the  use  of  simpler  algorithms  in  our  experiments 
permits  the  foot  placement  component  of  balance  to  be  examined  more  clearly  in  isolation.  The  third 
algorithm  is  more  practical,  demonstrating  high  performance. 
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All  horizontal  control  techniques  we’ve  explored  operate  within  a  framework.  One  part  of  the 
framework  is  the  regular  cyclic  activity  of  vertical  hopping  that  synchronizes  the  flow  of  balancing 
activity.  The  four  events  of  hopping,  lift  off,  peak,  touch  down,  and  bottom  play  an  important  role 
here.  For  instance,  all  of  our  methods  start  positioning  the  foot  at  peak  and  finish  doing  so  just  before 
touch-down.  So  in  this  case  vertical  hopping  events  regulate  the  flow  of  horizontal  control  events. 

In  addition  to  this  timing  part  of  the  framework  there  is  a  second  hierarchical  part.  In  the 
context  of  the  one  legged  model,  we  analyze  horizontal  control  as  a  three  level  process: 

•  At  the  highest  level  desired  trajectories  of  horizontal  motion,  *2(t)  are  controlled  by 

manipulating  the  vehicle's  state.  It  generally  takes  many  hops  to  substantially  modify 
horizontal  position,  so  this  is  a  low-bandwidth  process.  The  input  to  this  (ask  level  are 
user  specified  trajectories,  and  the  output  is  a  set  of  state  variables:  ( $2 ,  6>2,  x2)  = 

F[xM(t)]. 

•  The  middle  level  of  control  is  where  we  focus  most  of  our  attention.  At  this  level  vehicle 
state  variables  are  controlled  by  manipulating  the  leg.  either  its  angular  position  at 
touch-down  or  its  motion  during  stance.  This  process  acts  once  each  hop,  so  it 
generally  takes  a  few  hop  cycles  to  achieve  a  desired  state.  The  inputs  to  this  state  level 
are  state  trajectories  generated  by  the  task  level.  The  output  selects  leg  angle  or  foot 
placement:  0 ,  TD  =  F[  6^,  x^  ]. 

•  At  the  lowest  level2  desired  leg  angles  are  controlled  by  manipulating  torque  at  the  hip. 

This  process  runs  at  the  servo  rate  of  the  hardware  controller,  executing  many 
measurement/control  cycles  per  hop  -•  a  10  msec  control  cycle  is  typical.  The  inputs  to 
this  servo  level  are  leg  angles  specified  by  the  state  controller,  and  the  output  is  an 
actuator  control  signal:  u2(t)  =  F[  01d  J.  For  all  the  experiments  reported  here  the 
following  PO  controller  is  used  to  position  the  leg: 


(2.10) 


For  the  present  work  the  task  control  level  is  provided  by  an  operator  who  runs  the  simulation 
or  experiment.  The  servo  level  is  fixed  for  all  experiments  as  given  in  (2.10),  though  the  gains  may 
vary  from  experiment  to  experiment.  The  main  focus  of  our  work  is  on  the  state  level.  At  this  level  the 
leg  is  positioned  before  each  touch-down  so  that  the  state  at  next  lift-off  is  optimized  and  the 
behavior  of  the  leg  during  stance  is  specified.  The  following  sections  describe  a  number  of 
approaches  to  state  control. 

2.2.2. 1  Foot  Placement  Control 

The  simplest  form  of  horizontal  control  we  explored  uses  information  about  the  vehicle’s 
center  of  gravity  plus  linear  feedback  to  specify  foot  placement  during  each  touch-down.  Our 
intention  was  to  study  a  pure  foot  placement  controller,  in  which  no  attempt  is  made  to  control 
balance  during  stance.  Actually,  during  stance  the  controller  maintains  a  constant  hip  angle  between 
body  and  leg,  so  the  vehicle  behaves  like  a  rigid  inverted  pendulum  during  this  period. 


‘‘within  the  actuator  and  its  support  system  there  are  likely  to  be  additional  low  levels  of  control. 


a 


Two  factors  determine  where  the  foot  is  placed:  projection  of  center  of  gravity  and  errors  in 
state.  A  linear  function  of  errors  in  state  generates  a  displacement,  x£BR  which  is  added  to  the 
projection  of  the  center  of  gravity,  xcQ.  A  leg  angle  is  calculated  that  will  place  the  foot  at  this  point. 
Since  the  leg  has  mass,  movement  of  the  leg  changes  the  projection  of  the  center  of  gravity  - 
simultaneous  equations  must  be  solved.  The  following  analysis  is  done  in  a  moving  coordinate 
system  fixed  to  the  vehicle's  hip: 

First  we  find  horizontal  position  of  center  of  gravity: 


x  _  (w-r,)M1  Sin(^1)  4  r2M2Sin(fl2) 

“  ”  M1  +  M2 

The  following  linear  combination  of  state  errors  provides  corrective  feedback: 

XEBH  =  +  ^2^2~^2d)  +  *^X2  ”  X2d^  (2.t2) 

Placing  foot  at  desired  spot  requires  that: 

wSin<*i>  »  xco  +  xerr  <213> 

Substituting  (2.11)  into  (2.13)  and  solving  for  foot  placement  with  respect  to  hip  and  leg  touch-down 
angle: 


r1M1  +  wM2 

„  A  •  r  M  Sin(0  )  -  (M  +  M  )  x 
6.  =  Arcsin  -2—2 - 2 - 1 i — 1 

r1M1  +  wM2 


(2.14) 

(2.15) 


Figure  2-7  plots  02( t),  02(t),  and  x?(t)  for  a  step  in  horizontal  position  achieved  with  this  linear 
foot  placement  method.  Simple  rate  control  is  used  at  the  top  level  to  control  horizontal  position.  The 
lowest  level  servo  controller  is  given  by  (2.10)  with  parameters  specified  in  Appendix  II.  Balance 
using  this  method  is  remarkably  stable  -  translations  at  a  variety  of  rates  and  with  different  body 
attitudes  are  achieved  while  maintaining  the  upright  posture. 


A  limitation  of  the  method  is  the  maximum  achievable  rate  of  translation.  This  is  limited  to 
about  0.5  m/sec  by  the  relatively  restricted  motion  of  the  leg  while  in  stance.  Also,  limit  cycle 
oscillations  in  horizontal  velocity,  observable  in  Figure  2-7,  are  difficult  to  avoid.  Some  of  this  may  be 
due  to  the  ad  hoc  procedure  used  to  select  the  feedback  gains,  Kr  K2,  and  K3  --  they  were  adjusted 
by  hand  based  on  observed  performance. 


The  above  work  focused  solely  on  the  role  of  foot  placement  in  horizontal  control  so  that  we 
could  get  a  clear  picture  of  its  contribution.  It  was  found  that  balance  and  translation  can  be 
achieved,  though  translational  progress  is  very  slow  and  an  unnatural,  hunched  posture  is  required. 
The  back  and  forth  sweeping  motions  normally  made  by  biological  legs  when  walking,  running,  or 
hopping  are  absent.  We  now  explore  the  crucial  role  played  by  hip  torque  during  stance,  and  see 
how  this  additional  mechanism  enriches  behavior. 


TlME(sec) 


Figure  2-7:  Horizontal  position  step  controlled  by  linear  method. 

2.2.2. 2. Stance  Control 

As  we  have  said,  there  are  two  mechanisms  that  can  contribute  to  balance:  foot  placement  at 
touch-down,  and  leg  motion  during  stance.  In  this  section  we  describe  a  very  simple  approach  to 
horizontal  control  that  employs  foot  placement  aod  hip  torque  during  stance.  The  method  examined 
is  actually  a  generalization  of  the  previous  work  on  foot  placement,  as  you  will  see. 

What  should  a  hip  actuator  do  during  stance?  During  ideal  steady  state  translation  a  vehicle 
undergoes  no  horizontal  acceleration.  Therefore,  there  is  a  constraint  on  relative  horizontal  motion 
between  foot  and  body  for  nominal  translation  at  constant  velocity.  It  can  be  satisfied  throughout 
stance  by  choosing  appropriate  leg  angles  for  vertical  positions  of  the  body.  Satisfying  this  constraint 
causes  the  leg  to  sweep  a  range  of  angles  while  the  foot  is  touching  the  ground. 

For  each  stance  period  there  is  a  locus  of  points  over  which  the  vehicle’s  center  of  gravity 
passes  We  call  such  loci  CG -prints3.  Balance  of  the  vehicle  is  least  disturbed  when  the  center  of 


3  Analogous  to  footprints . 
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gravity  spends  equal  time  in  front  of  the  foot,  and  equal  time  behind  it.  Therefore,  under  nominal, 
steady  state  conditions  balance  is  accomplished  by  placing  the  foot  in  the  center  of  the  next  CG-print, 
a  point  that  can  be  predicted  from  x2  and  x2.  When  state  variables  deviate  from  their  desired  values, 
foot  placement  must  deviate  from  its  nominal  position  -  the  foot  is  placed  toward  the  front  or  rear  of 
the  CG-print  in  order  to  correct  state  errors.  Figure  2-8  illustrates  the  three  cases  possible. 


Figure  2-8:  Three  possible  cases  during  stance  period:  a)  Foot  is  placed  in 
center  of  region  swept  by  projection  of  center  of  gravity,  the  CG-print.  b)  Foot  is 
placed  toward  rear  of  CG-print,  causing  body  to  fall  forward  during  stance 
interval  c)  Foot  is  place  toward  front  of  CG-print.  causing  body  to  fall  rearward 
during  stance  interval. 


If  we  know  in  advance  the  duration  of  stance,  the  horizontal  velocity  of  the  body,  and  the 
geometry  of  the  vehicle,  then  we  can  calculate  an  appropriate  leg  angle  for  touch-down  and  a 
sweeping  function.  To  first  order  the  time  spent  in  stance  is  determined  by  the  main  spring  and  body 
mass.  The  natural  frequency  of  this  oscillating  system  is: 


Wn  = 


M. 


The  vehicle  spends  about  a  half  cycle  on  the  ground,  so  the  duration  of  stance  is: 


(2.16) 


T 


STANCE 


w 


u. 


(2.17) 


For  translational  velocity  x  the  horizontal  distance  traversed  by  the  body  during  stance,  the  length  of 
the  CG-print  is: 


Ax 


STANCE 


xT 


STANCE 


(2.18) 


The  center  of  the  CG-print  is  calculated  in  the  same  way  that  xtd  is  calculated  for  the  linear  foot 
placement  method.  We  repeat  (2.11),  (2.12),  (2.13),  (2.14)  and  (2.15)  here  for  convenience.  First  the 
horizontal  position  of  center  of  gravity: 
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(w-r^M,  Sin(tf  n)  +  r2M?Sin(02) 

Xco  M,  +  M2 

Linear  error  function: 

(2.19) 

Xerr  =  K1^2-^2d*  +  K2^2-^2d^  +  K3^x2  ”  X2d^ 

Factor  in  leg  mass: 

(2.20) 

wSinU?,)  =  xoG  +  xtRR 

Solving  for  the  center  of  the  foot’s  sweep  during  stance  with  respect  to  hip: 

(2.21) 

,  r?M2  Sin(g2)  -  (M,  +  Mg)  xerr 

CENTER  r1M1  +  wM2 

(2.22) 

Foot  placement  at  touchdown,  then  is: 

Ax 

X  =  X  +  - STAHCE 

TD  CENTER  2 

(2.23) 

For  vertical  hopping  in  place,  where  x2  TQ  =  0,  (2.23)  reduces  to  (2.14)  of  the  linear  foot  placement 
method.  Now  the  linear  sweeping  rule.  At  time  t  during  stance: 

stance 

(2.24) 

x(t) 

0Jt)  =  Arcsin  (-ii) 
w 

(225) 

We  have  implemented  simulations  of  linear  sweep  control  that  show  dramatic  improvements 
in  the  quality  and  speed  of  horizontal  locomotion  over  the  linear  position  method.  Figure  2-9  shows  a 
.75  m/sec  translation.  In  this  plot  the  horizontal  velocity  is  well  controlled.  Body  attitude  is  stable  in 
an  upright  position.  The  cartuon  of  Figure  2-10  lets  one  more  easily  visualize  the  results  of  this 
simulation. 

A  variation  of  the  above  stance  control  method  is  used  when  desired  horizontal  velocity  is  not 
constant  as  originally  assumed  for  the  derivation.  During  horizontal  acceleration  instead  of 
determining  foot  placement  and  sweep  magnitude  solely  on  the  basis  of  x2  ,  as  done  in  (2.18)  and 
(2.23),  a  compromise  between  actual  and  desired  velocity  is  used: 

Axstance  =  l  max<  min(*2,d  -  X2-  AxmJ'  "  AxmJ  +  X21  Tstance  <2  26> 

where 

Axmax  is  the  maximum  allowed  acceleration 
x2  d  is  the  desired  horizontal  velocity. 

This  algorithm  stretches  the  leg  forward  and  lengthens  the  stride  in  order  to  accelerate.  Velocity  is 
automatically  ramped  up  or  down  with  roughly  constant  acceleration.  Figure  2-11  shows  data  plotted 
for  the  case  where  the  vehicle  starts  at  rest  with  desired  velocity  of  4  m/sec.  Figure  2-12  replots  the 
data  of  2- 1 1  in  cartoon  form  where  the  sequence  of  positions  can  be  visualized. 


TIME  (sec) 


Figure  2-9:  Sweep  contiol  with  constant  horizontal  velocity  of  .75  m/sec. 


Figure  2-10:  The  data  of  Figure  2-9  replotted  in  cartoon  form.  Dotted  Hnes 
indicate  path  of  body  and  foot.  40  msec/dot,  1  sec/stick  figure. 

The  data  shown  here  are  by  far  the  best  we  have  produced  for  any  form  of  horizontal  control. 
However,  there  are  still  some  problems.  It  turns  out  that  at  high  speeds  stubbing  the  toe  is  difficult  to 
avoid  with  a  leg  of  the  present  design.  For  this  reason  an  articulated  leg  that  can  substantially  retract 
is  important  for  achieving  very  high  velocity  translation. 
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Figure  2-11:  Sweep  control  with  horizontal  acceleration. 


Figure  2-12:  Cartoon  of  data  from  Fig.  2-11.  20  msec/dot.  .6  sec/stick  figure. 


2. 2. 2.3  Predictive  State  Space  Method 


Another  set  of  experiments  was  conducted  using  an  entirely  new  method  of  control  that 
extends  Raibert’s  State  Space  Memory  Method  [227].  The  Predictive  State  Space  Method  is  a  means 
of  solving  the  complete  nonlinear  dynamics  for  a  hopping  system  without  having  to  do  lengthy 
calculations  or  numerical  integrations  in  real  time.  Instead,  a  large  table  is  maintained  in  which  are 
stored  future  state  data.  Each  address  into  the  table  is  a  function  of  the  current  state  and  a  control 
vector.  At  each  such  address  is  stored  the  corresponding  future  state. 

The  predictive  state  space  method  is  a  dynamic  inverse  method,  in  that  knowledge  of  the 
relationship  between  desired  system  state  and  available  control  actions  is  used  to  choose  an 
appropriate  control.  We  motivate  this  approach  by  casting  the  balance  problem  for  a  hopping 
mechanism  in  the  following  terms: 

Given  complete  state  information  at  the  time  of  touch-down,  what  leg-body  angle 
maintained  throughout  stance  will  move  the  system  to  minimize  the  state  error  at  the  time 
of  next  LIFT-OFF? 

The  predictive  state  space  method  is  a  way  of  predicting  state  at  a  future  time,  tp,  based  on 
augmented  state  at  the  present  time,  tp.  We  define  a  multi  dimensional  vector  space  T  such  that  each 
dimension  of  T  corresponds  to  one  element  of  an  augmented  system  state  vector,  X.  The 
components  of  X  are  n  state  variables  and  i  control  variables.  For  each  point  in  T  there  is  a  future 
state  vector  that  predicts  the  state  of  the  system  at  a  specific  time  in  the  future,  t2  --  the  present 
augmented  state  vector  points  to  a  future  state  vector. 

If  such  a  vector  field  is  accessed  at  touch-down,  and  if  the  future  state  vectors  correspond  to 
the  time  of  next  lift-off,  and  if  the  i  control  signals  are  completely  determined  by  their  values  at  lift¬ 
off,  then  control  is  achieved  as  follows:  At  each  touch- down  the  current  state  vector  exclusive  of 
the  /  control  elements  determines  an  /-subfield  of  T.  By  minimizing  a  performance  index  over  this 
subfield  a  best  future  state  vector  is  found.  The  location  of  the  best  future  state  vector  in  the  subfield 
indicates  best  values  for  the  i  control  variables. 

When  each  dimension  of  F  is  quantized,  this  approach  can  be  implemented  with  a  finite 
memory.  For  n  state  variables  and  i  control  variables,  each  quantized  to  M  values,  there  are  Mn*' 
hyper-regions,  each  storing  n  values.  A  Nyquist  like  sampling  rate  applies  to  the  selection  of  M  --  the 
table  must  be  quantized  at  a  fine  enough  level  to  capture  the  bandwidth  present  in  the  variations  of 
future  state. 

At  one  event,  t  the  predictive  state  space  method  makes  predictions  concerning  another 
event,  tp.  During  the  interval  that  separates  these  events  the  system  control  variables  must  behave  in 
a  restricted  way  -  they  must  vary  over  the  interval  with  at  most  i  degrees  of  freedom.  That  is,  for  each 
augmented  state  at  tp,  there  is  exactly  one  control  trajectory  during  the  interval.  The  question  of 
finding  suitable  control  functions  of  augmented  state  is  an  open  problem. 
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What  will  the  state  be  at  tf  for  a  given  augmented  state  at  tp?  Such  data  may  be  obtained  by 
simulation,  by  evaluating  closed  form  solutions,  or  by  making  measurements  on  a  behaving  system. 
Though  it  has  not  yet  been  attempted,  data  could  be  obtained  by  taking  measurements  from  a 
physical,  behaving  system.  Such  a  learning  controller  would  benefit  from  experience  gained  in 
practice,  and  could  adapt  to  changes  in  the  mechanical  characteristics  of  the  system  [227]. 

What  has  been  described  so  far  has  no  specific  connection  to  legged  locomotion.  But  let  us 
ask,  what  happens  if  some  parts  of  the  mechanical  system  we  are  trying  to  control  engage  in  very 
regular  repeatable  activity.  Does  that  make  the  problem  easier  or  reduce  its  dimensionality?  Normally 
to  control  a  system,  we  would  have  to  include  all  state  and  control  variables  in  the  augmented  state 
vector.  However,  for  a  locomotion  system  engaging  in  regular  rhythmic  vertical  hopping,  to  first  order 
the  vertical  state  variables  (eg.  w.  w,  y2.  y2.  u2)  always  have  the  same  value  at  touch  down  and  follow 
nearly  the  same  trajectory  throughout  stance.  Therefore  these  variables  can  each  be  quantized  to 
one  level  rather  than  M,  resulting  in  dramatic  reductions  in  table  size. 

We  have  used  the  predictive  state  space  method  to  control  the  planar  hopper.  Body  angle  8r 
body  angular  rate  82.  and  horizontal  velocity  x2  are  state  variables  that  access  a  table,  n  =  3.  Leg 
angle  8 1  is  a  control  variable,  /  =  1 .  These  variables  index  a  4  dimensional  space.  Each  dimension  of 
the  memory  is  quantized  to  nine  levels,  M  =  9,  requiring  that  nM'  +  '1  =  19,683  values  be  stored.  To 
compensate  for  such  a  course  quantization,  linear  interpolation  is  performed  when  accessing  the 
memory. 

We  obtained  tabular  data  for  these  experiments  by  simulating  a  large  set  of  touch-down  • 
stance  •  lift-off  cycles  with  systematically  varied  initial  conditions.  As  in  the  earlier  work  on  linear 
feedback,  the  angle  between  leg  and  hip,  8}-82.  is  held  constant  during  stance.  Therefore,  the 
controller  determines  a  value  for  control  variable  8^  at  touch-down,  and  its  behavior  until  lift-off  is 
determined  by  the  augmented  state  vector,  in  this  case  a  subvector,  [8y8^. 

Use  of  the  table  requires  that  a  search  be  performed  for  the  hyper-region  containing  the  state 
vector  that  minimizes  a  performance  index.  We  employed  a  quadratic  index: 

pl  =  *  <VV«s/  (227) 


where: 

Q1,Q2,Q3  are  weights  chosen  by  the  user 
^2d,^2d,x2d  are  desired  values. 

Figure  2-13  plots  the  body  angle  and  horizontal  position  of  the  hopper  for  a  drop  balance  lest. 
In  this  test  the  hopper  is  dropped  from  a  height  of  0.3  m  with  an  initial  body  angle  of  0.8  radians.  The 
task  level  set  points  are  8^  =  0,  8^  =  0,  xM  -  0,  Under  control  of  the  predictive  state  space 
method  desired  foot  placement  for  the  impending  landing  is  repeatedly  calculated  at  10  msec, 
intervals  from  peak  until  touch-down.  After  touch-down  the  desired  leg-body  angle  is  no  longer 
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Figure  2-13:  Drop  balance  test  using  predictive  state  space  method. 

adjusted.  In  this  test  no  attempt  is  made  to  control  horizontal  position,  x2.  A  vertical  posture  with  no 
horizontal  motion  is  attained  in  about  6  sec. 
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Figure  2-14:  Lateral  step  controlled  by  predictive  state  space  method. 


The  predictive  state  space  method  was  used  to  control  a  lateral  step  in  position.  Figure  2-14 
shows  a  translation  in  which  x2  was  controlled  indirectly  through  x2.  Unlike  results  from  the  linear 
method,  here  horizontal  velocity  is  precisely  controlled.  Compare  Figure  2-14  to  Figure  2-7. 
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The  computational  costs  of  using  the  predictive  state  space  method  center  on  search  for  the 
state  that  minimizes  the  performance  index,  and  interpolation  once  the  correct  vector  is  found.  No 
time  is  spent  evaluating  equations  of  motion  directly.  As  we  said  earlier,  it  is  not  necessary  that  the 
control  variables  be  constant  during  stance,  only  that  they  do  not  vary  throughout  state  space  with 
more  degrees  of  freedom  than  are  represented  in  the  table.  This  means  that  control  signals  are 
perfectly  acceptable  provided  control  during  stance  is  completely  determined  by  state  at  touch¬ 
down.4 

We  are  exploring  a  form  of  control  that  combines  our  work  on  the  predictive  state  space 
method  with  our  work  on  stance  control.  As  before,  foot  placement  at  touch-down  is  determined 
from  the  predictive  state  space  table.  Rather  than  hold  the  hip  angle  constant  during  stance, 
however,  the  leg  is  swept  through  a  region  determined  by  a  function  of  horizontal  velocity  at  touch¬ 
down. 


So  far,  we  have  not  gotten  good  behavior  from  this  type  of  control.  Our  diagnosis  is  that  good 
stance  control  requires  an  additional  degree  of  freedom  in  control  that  reflects  the  relationship 
between  desired  and  actual  horizontal  velocities.  The  best  linear  stance  control  technique  permits 
the  difference  between  actual  and  desired  horizontal  velocity  to  affect  the  sweeping  rate. 


2. 2. 2.4  Polynomial  Approximation  to  Predictive  State  Space  Table 

We  have  shown  the  predictive  state  space  method  to  be  an  effective  approach  to  control  of  a 
non-linear  dynamic  system  with  few  state  and  control  variables.  However,  the  memory  requirements 
for  this  approach  become  severe  in  larger  applications.  With  this  in  mind,  we  have  asked  the 
questions,  “Can  the  data  in  the  predictive  state  space  tables  be  approximated  adequately  by  analytic 
functions  of  the  state  variables?  If  so,  with  many  fewer  coefficients  than  are  in  the  original  tables?" 
We  have  undertaken  to  evaluate  the  use  of  polynomial  surfaces  that  approximate  the  tabular  data. 


Given  N  =  n  +  i  state  and  control  variables,  polynomials  are  constructed  that  map  points  in  the 
augmented  state  space  to  estimated  future  state  vectors.  Each  of  n  polynomials  minimizes  the  total 
square  error  for  the  variable  it  approximates  across  all  data  points  in  the  predictive  state  space 
memory. 


Let  A  be  a  matrix  in  which  each  row  contains  values  of  the  N  state  and  control  variables;  let  B 
be  the  matrix  that  contains  future  values  of  the  state  variables  in  corresponding  rows.  The  matrices  A 
and  B  then  form  a  data  structure  for  the  predictive  state  space  memory.  Given  a  sequence  of  distinct 
terms  of  the  form: 

U  i4  U  M  Um  IkiJ  _ 

(2.28) 


✓  'll  *12  Jl3  *14 
*2  *3  *4  » 


'Ml  'M2  'M3 
’  *i  *2  *3  *4  ' 


4 Actually,  there  is  another  practical  limitation.  Since  interpolation  is  necessary  to  accomplish  good  control  with  tables  of 
finite  size,  it  is  also  required  that  small  variations  in  state  result  in  small  changes  in  control.  This  is  part  of  a  more  general 
consideration  that  governs  the  coarseness  with  which  the  predictive  state  space  memory  can  be  divided. 
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determine  a  row  of  the  M-coiumn  matrix  C  by  evaluating  these  terms  at  the  values  defined  by  the 
same  row  of  A.  Then 

(CtCX»CtB)  (2.29) 

is  a  linear  system  whose  solution  X  contains,  in  each  column,  the  coefficients  of  a  least  squares 
polynomial  that  estimates  the  values  in  the  corresponding  column  of  B  [249].  The  polynomial  is,  of 
course,  determined  by  the  choice  of  the  exponents  in  the  above  sequence. 


We  have  tested  the  use  of  least  squares  polynomials  in  control  of  the  simulated  one  legged 
hopping  machine.  In  this  case  6 y  d2,  and  x2  are  the  independent  variables  and  future  values  of 
6y  $2,  and  x2  are  the  variables  to  be  approximated. 


Figure  2- IS:  Drop  balance  test  controlled  by  86  term  polynomial.  Solid  lines 
show  results  under  control  of  polynomial  approximation.  Dotted  lines  are 
results  using  original  tabular  data. 


Several  polynomials  have  been  tested: 

•  A  70  term  polynomial  consisting  of  those  terms  where  the  sum  of  the  exponents  of  the 
four  independent  variables  is  less  than  or  equal  to  4.  The  root  mean  square  errors  across 
the  5421  points  in  the  state  space  memory  were  0.961 , 4.92  and  15.9  for  02,  $2  and  x2 
respectively.  The  trajectory  of  the  hopping  machine  diverged  severely  from  that 
determined  by  use  of  the  tabular  data. 

#  The  70  term  polynomial  was  augmented  with  16  additional  terms  consisting  of  a  limited 
selection  of  fifth  order  terms.  The  RMS  errors  decreased  somewhat  to  0.905,  4.83  and 
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12.9  for  the  86  term  polynomial.  This  change  did  not  significantly  improve  the  control 
system's  performance  in  the  drop  balance  test.  The  results  are  illustrated  by  the 
trajectory  plotted  in  Figure  2-15  where  it  is  shown  with  the  comparable  trajectory  for  the 
table-based  system. 

•  The  state  space  was  divided  into  16  subregions  according  to  combinations  of  the  signs  of 
the  four  independent  variables.  The  same  66  terms  were  fit  to  the  data  in  each  of  these 
subregions.  The  RMS  errors  were  reduced  further  to  0.283,  3.86  and  9.42.  The  resulting 
performance  of  the  control  system  was  disappointing,  however,  since  storage 
requirements  for  the  coefficients  were  increased  by  a  factor  of  16  over  the  previous  case. 
Among  other  problems,  this  piecewise  86  term  polynomial  had  discontinuities  near  the 
inter-region  boundaries.  Various  other  divisions  of  the  state  space  were  tested  using  this 
approach,  including  overlapping  regions.  Problems  were  encountered  when  systems 
were  singular  because  of  small  numbers  of  data  points  in  certain  subregions.  In  no  case 
was  the  fit  adequate  for  stable  control  of  the  simulated  hopping  machine. 

•  A  polynomial  was  constructed  using  all  terms  with  exponents  of  the  four  independent 
variables  between  0  and  4.  This  implies  625  terms  and  hence  a  linear  system  of  order 
625.  Using  Gaussian  elimination  the  system  was  successfully  solved  in  about  20  hours  of 
CPU  time  on  a  DECSystem  20.  The  resulting  fit  was  clearly  superior  to  the  earlier  ones; 
the  RMS  errors  were  reduced  to  0.246,  0.172  and  0.325.  Figure  2-16  plots  a  cross  section 
of  the  polynomial  surface  along  with  values  from  the  state  space  table.  The  remaining 
errors  still  resulted  in  inadequate  control,  however.  This  can  be  seen  in  Figure  2-17.  The 
polynomial-based  control  system  approached  the  set  points  along  a  path  similar  to  that 
determined  by  the  table-based  control  system.  However  when  the  set  points  were 
reached,  the  polynomial  system  drifted  and  finally  became  unstable. 

Keep  in  mind  that  the  time  required  to  determine  the  coefficients  of  the  polynomial  does  not 
limit  the  usefulness  of  the  approach  in  a  strong  way,  provided  evaluation  of  the  polynomial  can  be 
accomplished  with  adequate  speed.  However,  indefinitely  increasing  the  number  of  terms  is  not  an 
effective  approach  since  it  becomes  very  expensive  to  evaluate  the  resulting  polynomials.  Of  course, 
as  the  number  of  terms  increases  the  memory  required  to  store  the  coefficients  eventually 
approaches  that  required  for  the  original  state  space  tables. 

Despite  our  lack  of  success  with  this  method  to  date,  we  remain  optimistic.  Further  work  will 
include  sensitivity  analysis,  exploration  of  optimal  partitions  of  the  state  space  for  piecewise 
polynomials,  and  testing  of  spline  techniques  for  smooth  approximation  across  subregions. 

2. 2. 2.5  Optimal  Control 

The  feedback  gains  used  in  the  linear  methods  describe  above  were  chosen  and  adjusted  by 
hand.  Without  a  more  formal  method  for  selecting  gains  we  have  no  way  to  distinguishing  between 
those  performance  deficits  due  to  fundamental  limitations  and  those  due  to  poor  choices  of  gain.  The 
optimal  control  theory  gives  the  control  designer  rational  methods  for  choosing  gains.  However 
application  of  the  theory  to  the  present  problem  is  complicated  by  the  non-linear  dynamics  and  the 
non-holonomic  nature  of  the  locomotion  problem. 


Figure  2-16:  Cross  section  through  state  space  that  compares  tabular  fata. 
shown  by  "  ♦  "s.  to  625  term  polynomial.  Slice  of  state  space  specified  by  • 

S2  =  0.  Plotted  on  ordinate  are:  Left)  8^.  Right)  Xj. 

As  a  first  approximation  to  controlling  the  one-legged  hopper,  we  consider  a  model  with 
massless  leg  and  study  its  control  by  means  of  linearization  about  a  nominal  trajectory.  The  linearized 
model  will  be  posed  in  discrete  time  with  a  quadratic  performance  index,  and  this  will  be  controlled  by 
the  standard  theory  involving  a  Riccati  equation. 

As  one  example  of  this  method,  consider  the  problem  of  applying  hip  torque  while  the  hopper 
is  on  the  ground  in  an  attempt  to  bring  it  to  an  upright  posture  before  take-off.  We  assume  that  the 
foot  strikes  the  ground  and  remains  fixed  at  the  origin.  The  assumption  of  a  massless  leg  allows  us  to 
model  the  hopper  as  a  system  without  energy  loss,  so  we  can  take  u2  to  be  identically  zero.  When  w 
=  wQ,  the  main  spring  is  at  rest,  which  we  assume  to  be  the  case  at  touch-down  and  lift-off. 

Let  (x,y)  denote  the  coordinates  of  the  center  of  mass  of  the  body.  When  the  hopper  is 
hopping  in  place,  we  have  (with  u^bO): 


xtyaO 

(2.30) 

(2-31) 

ytt)  ■  -a  Sin  ( t|^ 

r1  .  gM 

(2.32) 
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Figu  re  2- 1 7 :  Drop  balance  test  under  control  of  625  term  polynomial. 


where 


a  = 


g*M2  2  M 
— -  +  y  (0)  - 


c  =  Arcsin 


|gM 


M  is  the  body  mass, 
k  is  the  main  spring  constant, 

t  *  0  is  the  time  of  touch-oown  (y(0)  =  wQ+  r ,  if  y(0)  <  0) 
r  is  the  distance  from  hip  to  center  of  gravity  of  body. 


The  time  of  lift  off  is 


T  =  2(w 


Hr 


(2.33) 


is 


We  take  this  trajectory  as  nominal  and  study  deviations  from  it.  Suppose  xtt),  ytt),  $2(X) 
another  trajectory,  and  define 

Ax(t)*x(t)-xfo,  (2.34) 

Ay(t) »  y(t)  -  ytt),  (2.35) 
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—  X(t)  =  A(t)  X(t)  +  B  u1(t). 
dt  1 


(2.41) 


We  want  to  control  this  system  from  t  =  Otot=T.  Divide  [0,T]  into  subintervals  of  length  -  and  then  let 

n 

kT 

t.  =  — ,  k  =  0,  -,n.  Let: 

K  n 

Xk  =  X<V-  \  =  A<V’  uk  "  ui  (2.42) 

We  have: 


*  Jbuk- 

n  n 


(2.43) 


Define: 

Q„  ■  diag  (\y  \2,  \3,  \4,  Xfl)  (2.44) 

R  =  1,  k*0,  -,n-1.  (2.45) 

To  control  the  system  so  as  to  minimize  X^OnXn  +  uk,we  let  Pk  be  given  by  the  Riccati  equation: 

(2.46) 


Pn  *  Qn 

n  n 


k  =  1 


Pk  »  (I  +  ;*,)T(Pk,,  - 


n  +  Pk  +  1(6,6) 


Pk+1BBTPkt1](l  +  -Ak),  k  *  N-1,—,  0,  (2.47) 


where 

pk + 1  (6.6)  is  the  (6,6)  element  of  Pk  +  1- 


Let: 


“  n2  +  Pk  +  1(6.6) 


BPk  +  i<l  + 


AJ. 


Then  the  optimal  feedback  control  law  is  given  by: 

Uk  ®  Lk 


(248) 


(2.49) 


This  control  requires  a  minimum  of  calculation  and  so  can  be  implemented  in  real  time.  More 
importantly,  it  will  allow  for  simulation  which  should  help  determine  the  main  features  of  the 
controlled  system.  It  is  also  possible  to  apply  this  control  law  to  models  with  legs  of  non-ze.  mass  to 
determine  its  robustness. 
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3.  Physical  Experiments 

This  section  describes  laboratory  work  aimed  at  building  and  testing  physical  legged 
machines  that  locomote  with  dynamic  stability.  Our  first  project  is  the  construction  and  control  of  the 
Planar  Hopper,  a  machine  with  one  leg  similar  to  the  ideal  device  described  earlier.  At  the  time  of  this 
writing  the  planar  hopper  is  able  to  produce  high  quality  vertical  hopping,  while  our  current  effort 
focuses  on  achieving  balance.  Our  second  pioject  is  aimed  at  moving  our  work  into  the  third 
dimension.  Two  designs  for  3-D  hoppers  are  presented,  a  short  term  design  that  is  simple,  and  a  more 
ambitious  long  range  design. 

3.1  Planar  Hopper 

Here  work  on  the  physical  Planar  Hopper  is  described.  We  include  a  description  of  the 
mechanism,  its  sensors,  and  progress  in  controlling  it. 

3.1.1  Mechanism 

Figure  3-1  is  a  diagram  of  the  apparatus.  The  important  features  of  this  mechanism  are  a 
body,  a  leg,  two  internal  bearings,  a  main  spring,  two  pneumatic  cylinders,  and  three  air  bearings. 

Body  Most  parts  of  the  planar  hopper  are  mounted  on  the  body,  or  connected  to  it.  The 

body  is  a  set  of  parts  machined  from  aluminum  stock,  with  manifolding  for 
distribution  of  compressed  air,  supports  for  the  actuators,  a  place  for  sensors  and 
electronics,  and  pillow  blocks  that  support  bearings  for  the  leg. 

Leg  The  leg  is  a  0.5  m  length  of  machined  square  aluminum  tubing,  with  a  rubber  tip  at 

the  foot.  The  leg  is  connected  to  the  body  with  a  coupling  that  provides  two 
degrees  of  freedom:  the  leg  can  translate  along  its  long  axis  through  the  body, 
and  rotate  about  one  of  its  short  axis  with  respect  to  the  body. 

Cylinders  Two  double  acting  air  cylinders  of  1.0625"  bore  actuate  the  hopper.  Each 

cylinder  housing  is  attached  to  the  body  with  trunion  mounts,  while  the  rods 
connect  to  the  leg  through  a  sliding  collar.  These  cylinders  are  mounted  in  such  a 
way  that  the  sum  of  their  lengths  determines  the  distance  between  the  sliding 
collar  and  the  body,  and  the  difference  of  their  lengths  determines  the  angle 
between  leg  and  body. 

Main  spring  A  metal  compression  spring  fits  over  the  lower  leg.  Its  lower  end  is  held  in  place 
by  a  bracket  fixed  to  the  leg,  while  its  upper  end  indirectly  supports  the  body 
through  the  sliding  collar  and  cylinders.  In  parallel  with  the  metal  compression 
spring  are  two  leather  tension  straps.  They  limit  the  maximum  length  of  the  metal 
spring. 


Figure  3-1:  Physical  Planar  Hopper  shown  in  front  and  side  view. 

Manifold  and  valves 

Between  two  plates  that  form  the  body  are  grooves  and  passages  that  form  a 
manifold  for  distribution  of  compressed  gas.  Eight  electrically  operated  solenoid 
valves  mounted  to  the  underside  of  the  body  control  air  flow  to  the  cylinders. 
Each  end  of  each  cylinder  is  controlled  by  a  pair  of  valves:  one  valve  connects  the 
cylinder  to  high  pressure  gas,  the  other  connects  it  to  atmosphere.  When  both 
valves  of  a  pair  are  off  no  gas  enters  or  leaves  that  end  of  the  cylinder.  Each  valve 
is  separately  controlled  by  one  bit  from  the  computer  and  by  a  transistor  switch. 
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Air  bearings  and  table 

Motion  of  the  entire  mechanism  is  constrained  to  a  plane  by  three  air  bearings  and 
a  table  inclined  to  45°,  as  shown  in  Figure  3- 1b.  Each  air  bearing  is  attached  to 
the  hopper  by  a  self  centering  bellows  coupling  through  which  air  flows.  Two  air 
bearings  are  attached  to  the  body,  and  one  to  the  lower  leg.  The  hopper  is  free  to 
translate  vertically  and  horizontally  in  the  plane  of  the  table,  and  to  rotate  about  an 
axis  perpendicular  to  'he  table  A  second  part  of  the  table,  perpendicular  to  and 
below  the  first  part,  acts  as  the  support  surface  upon  which  hopping  takes  place. 


Figure  3-2:  Paris  that  make  up  Planar  Hopper  body.  leg.  spring,  cylinders, 
valves,  manifold,  an  bearings,  and  assorted  miscellany 


The  hopper  operates  as  follows:  Simultaneous  in  phase  rhythmic  activation  of  the  two  air 
cylinders  causes  resonant  excitation  of  the  spring  body  system  Hopping  results  when  the  leather 
straps  restrict  extension  of  the  spring  during  oscillation.  While  the  device  is  in  flight  differential 
control  of  the  cylinders  causes  the  leg  to  rotate  relative  to  the  body,  thereby  enabling  selection  of  a 
new  point  for  foot  placement  on  subsequent  landing. 
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3.1.2  Sensors 

In  the  long  run,  the  hardest  problems  in  locomotion  may  be  sensing  problems.  How  can  a 
system  know  where  it  is  in  space  and  where  it  is  with  respect  to  other  objects  without  touching  them? 
How  can  solid  support  points  be  chosen  and  dangerous  ones  avoided?  And  how  can  all  this  be 
accomplished  in  a  system  that  is  bobbing  and  weaving,  oscillating  and  undulating  at  more  than  40 
km/hr?  In  biological  systems  these  problems  are  solved  by  a  variety  of  sensory  systems  that  work 
together,  vision  being  an  important  contributor. 

We  characterize  the  functions  that  sensors  perform  in  controlling  locomotion  systems  and 
other  forms  of  robots: 

•  They  provide  information  that  permits  control  of  actuators. 

•  They  provide  information  that  gives  control  over  a  system's  state  variables. 

•  They  provide  information  about  a  system's  interaction  with  its  environment. 

In  order  to  control  the  planar  hopper  a  number  of  measurements  need  to  be  made.  At  the 
lowest  level  the  controller  must  know  what  each  actuator  is  doing,  the  angle  of  the  leg,  and  the  length 
of  the  main  spring  -  in  our  design  this  information  is  provided  by  two  encoders  and  a  potentiometer. 
At  the  next  level  the  vehicle's  dynamic  state  must  be  assessable.  Horizontal  vertical  and  angular 
position  of  the  body  must  be  known,  along  with  velocity.  A  rate  gyro  and  sonar  provide  some  of  this 
information,  a  Selspot  motion  recording  system  fills  in  the  gaps.  We  have  not  dealt  with  obstacle 
detection  or  avoidance,  nor  with  irregular  terrain.  The  following  is  a  list  of  sensors  that  currently 
work,  or  that  are  being  implemented. 

Encoders  A  linear  encoder  is  mounted  on  each  of  the  bearings  that  move  along  the  leg. 

Number  1  is  mounted  on  the  leg-body  coupling,  number  2  is  on  the  sliding  collar 
at  the  top  of  the  spring.  These  electro-optical  devices  and  their  support  circuitry 
count  bars  of  a  1.  mm /cycle  square  wave  pattern  affixed  to  the  leg  as  the  leg 
passes  by.  Encoder  2  gives  information  about  compression  of  the  main  spring. 
Together  the  encoders  give  the  separation  between  the  body  and  sliding  collar. 

Body  potentiometer 

The  coupling  between  leg  and  body  is  instrumented  with  a  potentiometer  that 
measures  hip  angle.  The  body  potentiometer  and  linear  encoders  provide 
measurements  from  which  the  length  of  each  air  cylinder  can  be  calculated: 

cr  =  ^1 "  Cos^?) "  *4  Sin(gp)}2  +  {-12  +  w(t)  Sin(qp)  -  14  Cos(g>)}2  (3.1) 

cl  =  {_Ii  “  w(t)Cos(9>)  +  14  Sin(?)}2  +  {-l2  +  w(t)  Sin(*>)  +  14  CosC?)}2  (3.2) 

where 

Figure  3-3  defines  all  variables 

w(t)  is  obtained  from  the  difference  of  the  encoders 

tp  is  obtained  from  the  potentiometer. 
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Rate  gyro  We  have  purchased  an  oscillating  beam  rate  gyroscope  with  0.04  deg/sec 

resolution  to  provide  measurements  of  body  angle,  02 ,  and  body  angular  rate  02. 

It  will  mount  on  the  main  body  along  with  support  electronics. 

Foot  potentiometer 

During  stance  on  level  terrain  it  is  possible  to  measure  leg  angle  0 1  with  an 
instrumented  foot.  This  is  done  with  a  potentiometer  in  the  ankle.  Eric  Saund  of 
Caltech  constructed  such  a  foot  that  serves  as  a  prototype. 

Sonar  A  way  to  measure  altitude  y2  and  get  additional  body  angle  data  0?  is  to  use  a  pair 

of  down  looking  sonar  sensors.  Figure  3-4  shows  the  scheme  we  are 
implementing.  It  combines  Polaroid  sensors  and  drive  electronics  with  custom 


It  will  be  some  time  before  this  array  of  sensors  is  completely  functional.  In  the  interim  a 
commercially  available  measurement  system,  Seispot,  provides  the  information  needed  for  control. 
Selspot  is  an  electro -optical  system  that  records  the  paths  of  electronic  markers  as  they  move 
through  space.  The  markers  are  infrared  LEDs  that  are  attached  to  the  subject.  A  transducer 
generates  x  and  y  analog  signals  that  specify  the  average  location  of  light  focused  on  its  surface.  The 
entire  system  is  comprised  of  cameras  containing  the  solid  state  sensors,  a  controller  that  turns  on 
each  of  30  LEDs  in  sequence  every  3  msec,  a  multiplexer  that  separates  the  digitized  signals  into  30 


Figure  3-4:  How  sonar  will  be  used  to  measure  body  altitude  and  body  angle. 

coordinate  pairs,  and  a  computer  interface.  Use  of  two  cameras  permits  3-dimensional  localization  of 
the  LEDs. 

As  we  said,  Selspot  provides  feedback  for  control  experiments  while  other  types  of  sensors 
are  under  development.  In  addition  Selspot  is  a  means  of  independently  measuring  and  analyzing  the 
performance  of  an  experimental  system.  In  planar  hopping  experiments  where  one  camera  is 
adequate,  a  Selspot  camera  sits  on  a  nearby  tripod  overlooking  the  inclined  air  table.  See  Figure  3- 
5a.  LEDs  are  attached  to  the  hopper  in  five  locations  as  shown  in  Figure  3-5b. 

We  have  made  three  improvements  to  the  Selspot  system  as  sold  to  us  by  Selective 
Electronics: 

•  A  special  LED  scanner  permits  five  LEDs  to  be  scanned  at  2  KHz,  six  times  the  normal 
rate.  These  higher  rates  mean  more  precise  measurements  with  less  delay,  and 
ultimately,  better  control. 

•  A  microcoded  digital  filter  smooths  each  LED  position  value  and  calculates  a  smoothed 
velocity.  This  special  purpose  processor  frees  the  control  computer  for  other  activity. 

•  A  two  port  memory  interface  between  Selspot  and  our  computer's  UNIBUS  facilitates 
communication. 


3.1.3  Results 

After  shortening  some  hose  and  increasing  its  diameter,  after  replacing  a  sliding  linear 
bearing  with  a  rolling  one,  after  replacing  a  narrow  spring  that  buckles  with  a  wider  one  that  does  not 
buckle,  and  after  replacing  fixed  air  bearings  with  self-centering  bearings,  the  hopper  is  hopping 
vertically.  Recorded  data  for  one  test  run  are  plotted  in  Figures  3-6  and  3-7.  These  plots  look  very 


Figure  3-6:  Vertical  behavioi  of  physical  hopper  Left)  As  recorded  by  Selspot 
Right)  As  recorded  by  camera  with  low  shutter  speed. 


similar  to  those  obtained  in  simulation,  eg.  Figure  2-2.  Though  ever  increasing  hopping  altitudes  are 
not  obtained,  the  foot  clears  the  ground  by  more  than  3  inches  at  peak. 


Balance  during  hopping  has  not  yet  been  accomplished,  though  our  progress  in  this  area  is 
good.  We  are  now  experimenting  with  a  linear  balance  algorithm  similar  to  the  one  explored  in 
simulation.  Completion  of  the  Selspot  filter  has  permitted  us  to  try  this  even  though  the  sonar  and 
gyro  sensors  are  still  being  developed.  The  actual  construction  and  testing  of  this  physical  system 
has  taught  us  basic  lessons  we  will  remember  in  the  future: 


•  Unsprung  mass  in  a  leg  must  be  minimized.  If  not,  there  are  energy  losses,  large  forces, 
and  lots  of  noise. 

•  Springs  in  compression  buckle. 

•  High  performance  linear  bearings  require  great  care.  Light  weight,  speed,  and  efficiency 
are  not  easy  to  combine  in  a  linear  bearing. 

•  The  importance  of  adequate  gas  flow  is  easy  to  forget.  We  replaced  small  fittings  with 
larger  ones,  1/4  inch  hose  with  3/8,  small  valves  with  larger  valves,  and  larger  valves  with 
still  larger  ones. 

•  When  two  actuators  are  mechanically  coupled  to  control  motions  in  two  degrees  of 


(m/sec) 

Figure  3-7:  Phase  plot  of  vertical  hopping  data  recorded  from  physical  hopper 
with  Selspot. 

freedom,  precise  trajectory  control  is  essential.  Bang  bang  control  is  not  appropriate  in 
such  systems. 

We  made  some  bad  design  choices  early  on  that  lead  to  this  last  lesson.  We  have  had 
difficulty  in  separating  the  actions  of  the  actuators  into  a  vertical  part  and  a  horizontal  part.  In  our 
planar  design,  linear  extension  of  the  leg  and  torque  about  the  hip  are  achieved  by  coordinating  the 
actions  of  both  actuators.  They  must  move  in  precise  synchrony  in  order  to  produce  extension 
without  hip  torque,  and  hip  torque  without  extension.  Bang-bang  pneumatic  control  of  coupled 
actuators  is  not  a  good  method  for  achieving  such  motions.  Three  solutions  present  themselves:  find 
a  better  algorithm  for  using  temporal  modulation  of  on-off  valves  to  approximate  proportional  control, 
replace  the  on-off  valves  with  proportional  servo  valves,  decouple  the  cylinders.  Each  of  these 
options  is  being  explored. 


3.2  Design  of  3-Dimensional  Hoppers 

Balance  as  it  occurs  in  advanced  legged  systems  is  a  3-dimensional  phenomenon.  Therefore, 
if  we  are  to  fully  understand  balance  and  take  advantage  of  it,  we  must  extend  our  physical 
experiments  into  the  third  dimension  where  there  are  six  degrees  of  freedom.  We  have  begun  to  do 
so  by  designing  experimental  walking  machines  that  embrace  balance  in  3-D,  and  that  incorporate 
what  we  have  learned  from  building  and  experimenting  with  the  planar  hopper.  The  goal  of  these 
designs  is  to  create  a  vehicle  for  learning  about  balancing  in  3-D  in  the  coming  year.  A  secondary 
goal  is  to  generate  preliminary  ideas  on  what  one  leg  of  a  multi-legged  balancing  vehicle  should  be 
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The  objectives  of  the  design  are: 

•  To  embody  dynamic  balance  capability.  The  machine  should  be  able  to  balance  about  a 
point  on  the  floor  while  hopping  in  place,  to  translate  in  a  preferred  direction  with  high 
speed  and  efficiency,  and  to  translate  in  any  direction  with  less  speed  and  efficiency. 

•  To  achieve  mechanical  efficiency  through  proper  tuning  of  the  components  of  a  spring- 
mass  system.  Hopping  should  be  efficient. 

The  present  intent  is  to  leave  for  later  the  control  of  rotation  about  the  vertical  axis,  and  simply  design 
with  a  large  polar  moment  of  inertia  to  minimize  rotation. 

The  results  are  designs  for  three  3-D  machines.  Two  are  simple  machines  that  function  with 
circular  symmetry.  They  are  designed  to  hop  in  place  or  translate  in  any  direction  over  relatively  flat 
terrain.  We  will  build  at  least  one  of  them  in  the  coming  year.  The  third  design  is  more  advanced, 
reflecting  our  initial  thinking  about  how  to  optimize  a  one-legged  balancer  for  use  in  a  multi-legged 
system.  We  believe  that  the  basic  role  played  by  each  leg  in  such  a  system  is  similar  to  its  role  in  a 
monoped,  but  that  the  design  must  be  biased  for  forward  motion  and  for  coupling  between  the  legs. 

3.2.1  Simple  3-D  Hoppers 

We  have  designed  two  simple  3-D  hoppers.  The  first,  shown  in  Figure  3  8,  has  a  linear  sliding 
leg  that  is  gimbal  mounted  to  a  wide  body  and  frame.  The  leg  is  comprosed  of  a  long  double  ended 
pneumatic  cylinder  with  an  extension  at  one  end.  The  cylinder  acts  both  as  an  actuator  that  changes 
length  of  the  leg  under  control  of  an  on-off  valve,  and  as  a  spring  that  stores  energy  in  gas 
compression  during  stance.  Two  hydraulic  cylinders  angle  the  leg  with  respect  to  the  body  in  two 
degrees  of  freedom.  These  cylinders  are  controlled  by  flapper  type  proportional  servo  valves.  The 
basic  design  has  strong  similarities  to  the  planar  hopper  with  the  following  important  improvements: 

•  Motion  that  changes  leg  length  is  decoupled  from  motion  that  changes  leg  angle. 

•  Bang-bang  pneumatic  control  is  no  longer  responsible  for  precise  positioning. 

•  Energy  is  stored  efficiently  in  compressed  gas  rather  than  in  a  metal  compression  spring 
that  buckles  and  binds. 

•  The  only  sliding  bearing  is  that  of  the  vertical  actuator  -  since  there  are  three  points  of 
support  there  should  be  little  binding. 

The  second  design,  shown  in  Figure  3-9,  features  a  leg  with  all  rotary  joints.  Two  hydraulic 
cylinders  with  proportional  servo  valves  control  hip  rotation  in  two  directions.  The  angle  of  the  entire 
leg  is  changed  by  these  actuators.  The  knee  incorporates  two  gears  that  act  as  an  angle  splitter  so 
that  the  upper  and  lower  legs  fold  at  the  same  rate.  Acting  with  the  parallel-bar  mechanism  of  the 
thigh,  this  angle  splitter  causes  upper  and  lower  legs  to  maintain  equal  angles  with  respect  to  the 
rotating  portion  of  the  hip.  This  linkage  structure  permits  a  single  actuator  to  produce  linear  foot 
motion.  The  third  actuator  is  a  hydraulic  cylinder  working  through  a  tension  spring  to  lengthen  and 
shorten  the  leg. 
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Figure  3-0:  Simple  3-dimensional  hopper  with  linear  acting  leg. 

The  basic  difference  between  these  simple  3-D  machines  is  the  method  for  obtaining  linear 
leg  motion:  one  uses  the  linear  bearing  of  a  pneumatic  cylinder,  the  other  uses  gear  and  cable 
linkages.  Both  designs  use  a  pair  of  precisely  controlled  hydraulic  actuators  to  control  leg  angle,  and 
both  use  a  third  actuator  to  change  leg  length.  Neither  will  carry  its  own  power  supply  nor  its  own 
computer  --  they  will  connect  with  hoses  to  a  stationary  hydraulic  power  supply,  and  with  wires  to  an 
off  board  computer.  An  on  board  accumulator  will  guarantee  adequate  central  response  and 
minimize  peak  flow  rates  through  the  umbilical.  Some  analog  hardware  will  be  present  on  board  to 
support  joint  sensors,  a  set  of  rate  gyros,  and  force  sensors. 


It  is  anticipated  that  a  large  amount  of  tuning  of  the  mechanism  and  controls  will  be  required 
before  effective  locomotion  is  achieved.  To  facilitate  this,  it  is  planned  to  build  an  arm,  or  other 
restraint  device,  to  which  the  machine  will  be  attached.  This  will  enable  development  of  hopping  in 
stages:  hop  in  place  while  externally  stabilized,  balance  in  two  dimensions,  balance  in  three 
dimensions.  This  approach  will  also  help  us  to  observe,  measure,  and  understand  the  various 
phenomena  occurring  during  each  behavior. 


3.2.2  Advanced  3-0  Hopper 

The  idea  of  a  one  legged  hopping  machine  is  important  for  legged  locomotion  not  because 
one  legged  vehicles  will  come  into  wide  spread  use,  but  because  dynamically  balanced  multi-legged 
vehicles  will  incorporate  principles  revealed  by  studying  the  extreme  one-legged  case.  Therefore  it  is 
useful,  even  at  this  early  point  in  balance  research,  to  contemplate  what  the  legs  of  a  running 
machine  might  look  like.  We  ask  this  question  by  proposing  a  specific  leg  design  that  will  provoke 
thought  and  discussion. 
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Figure  3-10:  Preliminary  leg  design  for  multi-legged  balancing  vehicle. 

Figure  3-10  embodies  the  basic  concept  and  more  significant  features  of  an  advanced  3-0  leg 
as  presently  envisioned.  The  design  begins  with  the  basic  structure  of  the  simple  articulated  hopper: 
hip  rotation  is  controlled  about  two  axes,  angle  splitter  in  the  knee,  and  parallel-bar  linkage  between 
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hip  and  lower  leg.  To  this  has  been  added  a  foot  and  increased  range  for  fore  and  aft  him  motions. 
The  lower  leg  and  spring  form  a  linkage  that  tends  to  keep  the  foot  parallel  to  the  upper  leg.  Thus, 
extension  and  contraction  of  the  three  elements  of  the  leg  can  be  controlled  by  a  single  actuator.  The 
considerable  elasticity  of  this  spring  will  be  adjustable  in  order  to  make  testing  easier. 

The  design  incorporates  four  hydraulic  actuators,  two  that  balance  and  two  that  supply 
propulsive  energy.  Fore  and  aft  rotation  of  the  hip  is  controlled  by  an  actuator  in  series  with  a  spring. 
During  steady  state  hopping,  the  leg  will  swing  at  its  resonant  frequency,  requiring  only  small 
amounts  of  energy  from  the  actuator  to  maintain  the  motion.  This  arrangement  ol  spring  and  actuator 
is  based  on  Ivan  Sutherland's  idea  for  a  tuning  fork  quadruped.  A  second  actuator  produces  fine  fore 
and  aft  motions  by  rotating  the  knee.  A  third  actuator,  also  in  series  with  a  spring,  acts  on  the  upper 
leg  to  cause  the  leg  to  lengthen  and  shorten.  The  angle  splitter  and  parallelogram  linkages  cause  the 
action  of  this  cylinder  to  move  the  toe  along  a  straight  line  that  passes  through  the  hip.  Operating 
directly  on  the  hip,  a  fourth  actuator  causes  lateral  displacement  of  the  entire  leg. 

An  articulated,  three  element  leg  has  been  chosen  as  having  distinct  performance  advantages 
over  other  arrangements.  Compared  to  linear  sliding  pogo  stick  designs,  the  articulated  leg  has  the 
following  advantages: 

•  Sliding  joints  are  eliminated,  thereby  reducing  inefficiency  and  fabrication  problems. 

•  Unsprung  mass  is  minimized  by  using  a  series  of  jointed  masses  in  the  leg  -  at  touch¬ 
down  only  the  toe  is  unsprung. 

•  An  articulated  leg  can  reduce  its  vertical  dimension,  thereby  requiring  a  smaller  vertical 
clearance  than  a  comparable  linear  leg.  By  the  same  mechanism,  the  moment  of  inertia 
of  an  articulated  leg  can  be  reduced  in  order  to  swing  it  forward  more  easily  during  flight. 

•  It  is  easier  to  match  characteristics  of  springs  and  actuators  by  means  of  adjustable  lever 
arm  lengths. 

•  All  springs  and  actuators  act  in  tension,  eliminating  the  buckling  limitations  associated 
with  compression  springs. 

•  The  design  can  be  optimized  for  unidirectional  travel. 

It  is  significant  that  most  creatures  in  nature  that  are  capable  of  reasonable  speed  on  land  and  over 
uneven  terrain  employ  the  same  basic  three-element  articulated  leg  design.  Even  though  an 
articulated  leg  requires  only  three  degrees  of  freedom,  as  provided  by  the  simple  hoppers  of  the  last 
section,  the  addition  of  a  lower  element  improves  performance  in  three  ways: 

1 .  It  reduces  the  unsprung  mass. 

2.  It  causes  the  ground  force  to  act  nearly  through  the  knee,  minimizing  the  moment  at  this 
generally  fragile  joint. 

3.  It  permits  energy  storage  in  the  Achilles  tendon,  which  has  been  found  significant  in 
locomotion  of  many  animals,  most  notably  the  kangaroo  [3,  4J. 


I.  Equations  of  Motion  Planar  Hopper 

Equations  for  model  shown  in  Figure  2- 1 . 
y,  =  y0  -  +  ^Cosftfj)) 

x,  =  x’0  -  |,  -  ^Sinttf,)) 

y2  =  y0  +  w  Cos^j)  -  wtf JSin(^1)  -  v^Costtfj) 

-  r2(^Sin(^2)  +  ^Costtf,))  -  2w^1Sin(^|) 

x2  =  x0  +  w  Sin(^j)  +  wdjCo^tfj)  -  wtfjSinitfj) 

+  r2(®2Cos(fl2)  -  02Sin(02))  +  2w01Cos(01) 


=  Fy  -  FTCos(tf  j)  +  FNSin(tf  x)  -  Mjg 


M1*1  =  Fx  "  FTSiii(tf ,)  -  F^osfflj) 

Ij#!  =  -F^Cos^j)  +  F^Sin^j)  -  F^w-r^  -  Uj(t) 
M2i?2  =  F^ostfj)  -  F^Sin^j)  -  Mjg 


M2x2  =  FySi^tfj)  +  FNCos(tf1) 

h*2  =  FTr2Sin<*r* ,)  -  FNr2Cos(02-0 p  +  u2(t) 

where: 

(x0,y0)  are  the  coordinates  of  the  foot. 

(x1,y1)  are  the  coordinates  of  the  leg’s  CG. 

(x2,y2)  are  the  coordinates  of  the  body's  CG. 

Fx,Fy  are  the  vertical  and  horizontal  forces  on  the  foot. 

Ft,Fn  are  tangent  and  normal  forces  between  the  leg  and  body. 


Eliminating  xv  yr  x2,  y2,  and  FN: 
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Cos(«1)(M2Ww  +  I1)01  +  M2r2W  Cos{02)62  +  M2WxQ  +  =  (3.13) 

WM2(512WSin(^1)- 2^^008(5,)  +  r2022Sin(02)  +  r^^Sin^))  - 
r1FxCos(tf1)2  +  Cos(^1)(r1FySin(^1)  -  u^t))  +  FrW  Sin(^1) 

-Sin«?1)(M2Ww+l1)/?1  -  M2r2W  Sin(02)tf2  +  M2WyQ  +  M2WCos(0,)w  =  (3.14) 

\NM2(6*WCos(0J  +  20)wSin(01)  +  r2022Cos(02)  +  r^^Cosf^)  -  g) 

+  +  F.WCostf,) 

Cos(tf1)(M1r1W-l1)^1  +  K/^WXq  =  (3.15) 

W(M1r1^12Sin(^1)  -  F|.Sin(d1)  +  Fx)  -  Cosf^KF^Sintf,)  - 
F^Costf,)  -  u/t)) 

-Sin(tf1)(M1r1W-l1)(91  +  I^Wy,,  *  (3.16) 

WfM^tf^Cos^)  -  F^osf^)  +  Fy  -  Mtg)  - 
Sin(tf  1)(Fyr1Sin(^1)  -  F^Cos^)  -  ut(t)) 

-cos{e2-ej\f2o,  +  i2w*2  =  (3.i7) 

W(FKr2Sin(«2-^1)  +  u,(t))  -  ^Cos^-^M^FySintf,)  -  r^Cost^)  -  u^t)) 

where 


w  = 

w-r, 

Fk  = 

KS(W0"W  +  U2>  f0r  <W0“W  +  U2>  >0 
KS2(W(TW  +  U2)“BS2W 

otherwise 

(3.18) 

Fx  = 

VXo“Xyn  =  o)  “  BGX0 

0  u  otherwise 

for  y0  <  o 

(3.19) 

x'" 

It 

Vo -Vo  fory0<0 

0  otherwise 

(3.20) 
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II.  Simulation  Parameters 


M,  =  1  kg 
=  1  kg-m2 
r1  =  .5  m 
wQ  =  im 
Kp  =  900 
=  103Nt/m 
=  105Nt/m 
KS‘=  104Nt/m 

G 

0,-5. 


M2  =  10  kg 
l2  =  10  kg 
r2  =  .4  m  • 


Kv  =  60 


BS2  =  125  Nt- sec/m 
B.  =  75  N't- sec/m 
°2  =  03  -  1 
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